View Generation for Three - Dimensional Scenesfrom Video

| This paper focuses on the representation and view generation of three dimensional (3-D) scenes. In contrast to existing methods that construct a full 3-D model or those that exploit geometric invariants, our representation consists of dense depth maps at several preselected viewpoints from an image sequence. Furthermore, instead of using multiple calibrated stationary cameras or range scanners , we derive our depth maps from image sequences captured by an uncalibrated camera with only approximately known motion. We propose an adaptive matching algorithm which assigns various conndence levels to diierent regions in the depth maps. Nonuniform bicubic spline interpolation is then used to ll in low conndence regions in the depth maps. Once the depth maps are computed at preselected viewpoints , the intensity and depth at these locations are used to reconstruct arbitrary views of the 3-D scene. Speciically, the depth maps are regarded as vertices of a deformable 2-D mesh which are transformed in 3-D, projected to 2-D, and rendered to generate the desired view. Experimental results are presented to verify our approach.